Towards Multimodal Dialogue Management
نویسنده
چکیده
abstract EEective dialogue management is a key issue in speech-based interfaces to information systems since it can ensure a cooperative interaction with the user. Cooperativeness requires techniques which allow the user to eeeciently access information and also techniques which compensate for limitations in system knowledge and speech technology. The paper describes management techniques developed in a speech-only dialogue system and how they are being extended for a mul-timodal system which combines a direct manipulation interface with a spoken dialogue interface for a simple consumer information service.
منابع مشابه
Towards an Integrated Scheme for Semantic Annotation of Multimodal Dialogue Data
This paper investigates the applicability of existing dialogue act annotation schemes, designed for the analysis of spoken dialogue, to the semantic annotation of multimodal data, and the way a dialogue act annotation scheme can be extended to cover dialogue phenomena from multiple modalities.
متن کاملTowards Combining Finite State, Ontologies, and Data Driven Approaches to Dialogue Management for Multimodal Question Answering
Information-providing dialogue systems typically use one of the following dialogue strategies: finite-state based, frame-based, or agentbased. Recent extensions are concerned with hybrid models, where mixed automaton and information state approaches are combined. We report on our multimodal mobile Semantic Web access system SMARTWEB which uses a more rigid dialogue management strategy to ensure...
متن کاملMultimodal Dialogue Management - State of the art
This report is about the state of the art in dialogue management. We first introduce an overview of a multimodal dialogue system and its components. Second, four main approaches to dialogue management are described (finite-state and frame-based, information-state based and probabilistic, plan-based, and collaborative agent-based approaches). Finally, the dialogue management in the recent dialog...
متن کاملPartial Information in Multimodal Dialogue
Much research has been directed towards developing mul-timodal interfaces in the past twenty years. Many current multimodal systems, however, can only handle multimodal inputs at the sentence level. The move towards multimodal dialogue signiicantly increases the complexity of the system as the representations of the input now range over time and input modality. We developed a framework to addre...
متن کاملReference Resolution as a facilitating process towards robust Multimodal Dialogue Management : A Cognitive Grammar Approach
This paper tries to fit a novel reference resolution mechanism into a multimodal dialogue system framework. Essentially, our aim is to show that a typical multimodal dialogue system can actually benefit from the cognitive grammar approach that we adopt for reference resolution. The central idea is to construct and update reference and context models in a manner that imparts adequate level of un...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 1996